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ABSTRACT • .r 

This study examines the effect on learning of 

repeated plays of the simulation game "Trade and Develop" (T/D) 
also examines the effects of students* ability, using a general 
measure (determined by school tracking procedures) and a specific 
measure (achievement test in the specific class). The results of t 
study indicate that, after playing the basic version of T/D twice, 
further playing of the basic game or the advanced game will not 
increase students* understanding of the mechanics of the game 
(perceptions) , strategies of play, or analogies between the game 
model and the real situation. The effects of students* general 
ability on learning in the game were weaker for learning 
strategies than for learning of perceptions of the game, 
understanding of the analogies between the game and real 
learning of perceptions and of strategies was not related 
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IMRODI'CTORV S'lATEMENT 



The Center for Social Organization of Schools has two primary 
objectives; to develop a scientific knowledge of how schools affect 
their students, and to use this knowledge to develop better school 
practices and organization. 

The Center works through five programs to achieve its objectives. 

The Academic Games program has developed simulation games for use in 
the classroom. It is evaluating the effects of games on student learn- 
ing and studying how games can imarove interpersonal relations in the 
schools. The Social Accounts program is examining how a student's 
education affects his actual occuiational attainment, and how education 
results in different vocational ojtcomes for blacks and whites. The 
Talents and Competencies program is studying the effects of educational 
experience on a wide range of human talents , competencies , and personal 
dispositions in order to formulate--and research--impor tant educational 
goals other than traditional academic achievement. The School Organiza - 
tion program is currently concerned with the effects of student partici- 
pation in social and educational decision-making, the structure of com- 
petition and cooperation, formal reward systems, effects of school quality, 
and the developmenc of information systems for secondary schools. The 
Careers and Curricula program bases its work upon a theory of career 
development. It has developed a self-administered vocational guidance 
device to promote vocational development and to foster satisfying curri- 
cular decisions for high school, college, and adult populations. 

This report, prepared by the Academic Games Program, investigates 
how learning from playing a simulation game (Trade and Develop) is 
affected by the number of plays of the game and the ability tnd achievement 
levels of the students involved. 
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ABSTRACT 



This study examines the effect on learning of repeated plays of 
the simulation game Trade and Develop (T/D) . It also examines the 
affects of students' ability, using a general measure (determined by 
school tracking procedures) and a specific measure (achievement test 
in the specific class). 

The results of the study indicate that, after playing the basic 
version of T/D twice, further playing of the basic game or the advanced 
game will not increase students' understanding of the mechanics of the 
game (perceptions), strategies of play, or analogies between the game 
model and the real situation. 

The effects of students^ general ability on learning in the game 
were weaker for learning of strategies than for learning of perceptions 
of the game, or for understanding of the analogies between the game and 
real life. The learning of perceptions and of strategies was not re- 
lated to the specific measure of achievement, but the correlation be- 
tween learning of analogies and the achievement measure was significant. 
These results are discussed in terms of a learning model for games 
proposed by Coleman (1967, 1971). 
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INTRODUCTION 



The number of simulation games available has been increasing exponen- 
tially over the past twenty years (Zuckerman and Horn, 1970) . Classroom 
use of this new medium has become commonplace. While there is a grow- 
ing body of knowledge concerning the types of learning fostered by simu- 
lations (Boocock and Schild, 1968; Livingston, 1970; Lee, 1971; Fletcher, 
1971) much less is known about variables that mediate such learning. 

Inbar (1968) studied the effects of a number of student predispositions 
and variations in administration on learning in a simulation of a 
community disaster. He found that the major explanatory variable was 
the size of the playing group (p. 183). However, the game used by Inbar 
rec|uired the players to move one at a time, in sec^uence, and therefore 
the validity of his finding is restricted to this type of game. Fletcher 
(1971), in a study of the elementary social studies game Caribou Hun t, 
found that allowing students to examine the results of previous plays 
of the game increased the amount the students learned. Farran (1968) 
found that students who competed against one another as individuals 
learned more than students who worked as a group in competition with 
other groups. In a study using a business management game, McKenne> 
and Dill (1968) found that grouping by ability was detrimental to low- 
ability students and that having faculty-advisors did not help Increase 
group performance. 



O 

ERIC 



No studies to date have examined the effects of repeated plays 
of the game on learning. One purpose of the present study was to test 
the hypothesized advantage of multiple plays of a simulation game. It 
seems reasonable to expect that playing a simulation game several times 
would be more effective than playing it only once, for two reasons. 

The first involves the constraints imposed on a player when he commits 
himself to a certain strategy. In many games, the most important de- 
cisions are made at the beginning of tae game and cannot be changed. In 
other games, although decisions are made at regular intervals throughout 
play, each decision is constrained by the results of previous decisions. 
Thus the player can vary his basic strategy only by playing the game 
several times. The second reason involves the problem of learning to play 
the game. During the first play of a game the players are often confused 
and uncertain about the rules and mechanics of play. Only after they 
have mastered the rules can they experiment seriously with different 
strategies . 

A second purpose of the present study was to determine the effects 
of the players' academic ability on their learning in the game. In sum- 
marizing some of the gaming folklore and research on student ability, 
Boocock and Schild state, "Consistent empirical evidence shov/s that the 
relationship between learning in a game situation and performance in the 
conventional school setting is very weak," ( 1968 : 256 ) In other words, 
poor students learn about as much from games as good students do. On 
the other hand, Fletcher ( 1971 ) found that student academic ability was 
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related to certain types of learning in games (i*e*, the learning oi: 
the analogies between the game model and the real life situations) • 

Thus, while the advantage of games claimed by Boocock and Schild for 
^ 1^0 low ability students is an important one^ Fletcher s results indicate 
that it may not exist for some types of learning. Also, the measure of 
ability used may determine to some extent the results obtained <, In the 
present study both a general measure of ability (as determined by the 
school tracking procedure) and a specific measure of ability (achieve- 
ment test in the specific class) are included for study. 



METHOD 

The Simulation G 

The simulatX*’ 1 game used in the present study was Trade and Devel - 
op (Livingston, 1969) , a game designed to teach certain basic economic 
principles that affect the development of a nation. It is a highly sim- 
plified, abstract representation of an international economy. The major 
principles embodied in the rules and payoff structure of the game are 
the productivity of labor, the productivity of capital, and their inter- 
dependence • 

One play of Trade and Develop (T/D) consists of six rounds with four 
separate phases per round: production, trade, investment, and consumption. 
Each plaj^er has his own playing board, which depicts three sectors of the 
economy: basic industry, consumer industry, and agriculture. Decisions 
are indicated on these individual boards, so the players can make simul- 
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t.incoua decisions. Each player's goal is to maximize his country's 
satisfaction points, which are gained during the consumption phase of 
each round. At the end of the game, each player also receives bonus 
points based on the development of his country's productive capability. 
Differences between countries in the productive capability of the three 
sectors encourage trade and interdependence. Role playing is unimport- 
ant in T/D ; players are simply told that they represent the economic 
decision makers of their country. 

The advanced version of t/D . which was also used in this study, in- 
troduces a fourth sector into the economy--extractive industry. A 
country has the capability of extracting eittier iron ore or petroleum 
but not both. Thus the interdependence among the two types of countries 
Is increased. In both levels of the game players compete against other 
countries with the same capabM^'.y. Thus, there are two winners in each 
play of the game; one for each group of countries with the same develop- 
ment potential. 

S a>Tiplfe 

The subjects who participated in this study were 111 eighth grade 
students at a semi-rural junior high school in Carroll County, Maryland. 
They were members of four social studies classes taught by the same 
teacher. Two of these classes consisted of high-ability students and 
two of low- ability students. 
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Measures of Game Impact 

The measures of game impact (i.e., learning) consisted of categories 
of test items on the students' understanding of the game. The test items 
were divided into three categories: perceptions of the game, strategies, 
and analogies (Fletcher, 1971). Questions in the first category (percep- 
tions) were designed to test knowledge of the mechanics of the game. 



Example: In the Trade and Develop game, you get points for 

a) produ<;ing b) trading c) consuming d) all of these 

The items in the second category (strategies) test the student's knowledge 

of the game strategies that will yield the most points. 

Example: If you are going to get one tractor fleet, one factory, 

and one steel mill, which one should you get first? 

a) the tractor fleet c) the steel mill 

b) the factory d) it doesn't matter 

The third category (analogies) contained the items designed to determine 

whether the students understood the analogies between the elements of 

the game and those of real life. 

Example: The tokens with a picture of a man stand for what 

kind of people? 

a) all the people c) all the people who work 

b) all the men d) all the people in the army 

(The full test of understanding of the game is given in Appendix A.) The 
total score on all items as well as a score for each category were used 
as the dependent variables. 



Design of the Study . The major variable of interest in this study was the 
number of plays of the simulation game Trade and Develop . Three levels 
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of this treatment variable were included for investigation; playing the 
basic game twice (T^), playing the basic game four times (l^), and play- 
ing the basic game twice and the advanced version twice (T^) . (Students 
in worked on a map exercise while the others played the additional 
rounds of the game.) All activities were conducted as part of the stu- 
dents' regular social studies classes and administered by the regular 
social studies teacher. 



The second variable investigated was the ability level of the classes 
involved. Two of the classes were classified as high ability and the 
other two as low ability, on the basis of the school's tracking procedure, 
which uses homogeneous grouping. 



Students were assigned randomly to the three treatment groups within 
each of the four classes. Thus, the experimental design was a three-fac 
tor hierarchical analysis of variance: treatments by classrooms within 

ability levels.^ The ANOVA Layout showing the sources of variance, de- 
grees of freedom, and the appropriate F-ratios is given in Table 1 
(Myers, 1966; 223). Table 1 also shows the specific null hypotheses 
tested by each F-ratio. 



^The major advantage of this design is that the variability between 
classrooms at each level of ability can be extracted as a source of var- 
iance and analyzed. The meijor disadvantage of this design is that the 
d€igrees of freedom for the F-ratios of primary interest are small, and 
therefore the significance tests lack statistical power. However, if the 
observed effects for classrooms and classr^^oms-by■■•l..reatmen1;E are suffi- 
ciently small, then the variance and the degrees oJ' freedom associated 
with these effects may be pooled with the VTithin-cell varicince and degrees 
of freedom, to increase the statistical power of the significance test. 
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The students had taken a mid-term exam on economic geography just 
prior to playing the game. The relationships between this measure of 
achievement and the game impact measures were also investigated. This 
test was considered a specific measure of ability as opposed to the 
general ability levels determined by the school tracking procedures. 

The data were analyzed using Finn's (1^-68) MULTIVARIANCE pregram 
on the University of Maryland's Univac 1108 computer. 

RESULTS 

There were no significant differences between the treatment , groups 

I 

(T^, and T^) on any of the game impact measures. For the t.ptal on 

the test of understanding the game and for its analogies subtest there 

was a significant treatment-by-class interaction effect- Howev,pr, the 

differences that produced this effect were closely matched by d|ifferences 

in student achievement on a test taken before the students playjed the 

» 

game. Figure 1 illustrates this relationship. There was also. a signi- 
ficant effect for ability on all the measures, with high-abili:y stu- 
dents out^jer forming low-ability students on the: total test and each 
subtest. Table 2 presents the means for each treatment group in each 
class (the cell means) on the game impact measures and on achievement, 

i 

Tables 3 and 4 present the results of the analysis of variance for 
each of the game impact measures. For the purpose of pooling* variances, 
a C/A or TC/A effect was assumed not to exist when its associated F-ratio 
vrould occur under the null hypothesis with probability of v+0 or greater. 
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Wh,.r. the associated p-value was less than .40, no such assumpticn was 
made, and the variances were not pooled.^ While the effect of ability 
was significant in all the subtests for understanding of the game, this 
effect was smallest in the strategies subtest, accounting for only 11 
percent of the total variance, as compared with 22 percent and 27 percent 
in the other two subtests (as determined by the correlation ratio eta 

squared) • 

The relationships between classroom achievement and the game impact 
measures were studied by means of a correlational analysis. Table 5 
shows the average within-cell correlation of achievement with each of 
the measures, of these correlations only the one between achievement 
and the analogies subtest was significant (p < .05; two-tailed test). 

Two other variables of Interest on which info:rmation was available 
were sex of student and whether or not the student had acted as a scorer 
in at least one game. The correlations of these dichotomous variables 
with understanding of the game are shown in Table 6. The only correla- 
tion that reached significance was between sex of student and the ana- 
logies eabtest; the girls outperformed the boys. However, even this 
relationship becomes non-significant when achievement is taken into 
account; the partial correlation between sex of stvdent and analogies 
score, controlling for achievement, wan .19. 



^For a discussion of this technique, see Myers (1966, pp. 283-288), 
Kick (1968,, pp., 214-217), or Winer (1962, pp . 202-207). 
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DISCUSSICN 



The results of this experiment Indicate that, for t wudents who 
have played the simulation game Trade and Develop twice in its basic 
version, further playings of either the basic game or the advanced 
game will not enhance their understanding of the mechL^nics of the 
game (perceptions), strategies of play, or analogies between the game 
model and the real situation. It is evident from the group means 
given in Table 2 that after playing the game four times even the high 
ability students scored low In terms of their understanding of the 
game. On the average, students were able to answer correctly only half 
of the perceptions and strategy questions. High ability students, on 
average, answered three-fourths of the analogies questions correctly 
and the low ability students answered half of them correctly. 

These results are consistent with the answers students gave to the 
question "How many more times would you like to play Trade and Develop?", 
which was asked at the end of the last game. A number of students in 
each of the groups indicated that t.aey were just beginning to understand 
the game. Furthermore, these students indicated that they wanted to 
continue playing the game once or twice for the rest of the semester. 

It may be that such periodic use of games in the classroom would provide 
for more effective learning. The g;ame period could function in a manner 
analogous to the laboratory period in the physical sciences (as suggested 
by Lee, 1971 and others). 
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In addition to providing the benefits of multiple play mentioned in 
the introduction, such periodic play would allow time for the student 
to reflect upon his previous performance, discuss his experience with 
others, and plan new strategies. 



The effects of student ability on learning in the game are basically 
in agreement with those found by Fletcher (1971), in that the effect of 
ability was weaker for learning of strategies than for perceptions of 
the game or for understanding of the analogies between the game and 



real life. This assoc 



iation is at odds with the assertion of Boocock 



and Schild (1968) mentioned in the introduction. 



The association between student achievement and understanding of 
the game is more in line with the Boocock and Schild claim in that two 
of the subtests were not related to achievement. However, the correla- 
tion between analogies and achievement is significant. In addition, 
this relationship was observed within treatment groups and across treat- 
ment groups within classes where the restriction in the variation of 
achievement would tend to restrict the size of a correlation coefficient 



To understand better the results for achievement and ability it 
may be useful to discuss a model for learning from games presented by 
Coleman (1971). Coleman divides learning situations into two categories, 
real-life and classroom. Within this framework, simulation games fall 
under the category of real-life learning. The three major stages within 
real-life learning are: 
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Stage 1 - Actions in the particular situation 

Stage 2 - Understandi Mg the particular situation 

Stage 3 - Understanding the general case 

In terms of the understanding-the-game test, strategies measure 

learning at Stage 1. That is, a person may know the optimum strategy 

without understanding why it is best. Similarly, the perception items 

measure learning between Stages 1 and 2, while the measure of analogies 

involves making generalizations between Stages 2 and 3, from the game 

to the real situation. Coleman argues that intellectual ability is 

least important for learning at stage one and most important for learn- 

2 

ing at Stage 3. The squared correlation ratios ( 7 \ ) Table 4, show- 
ing the percent of variance in each of the three subtests accounted for 
by ability level of the class, order the stages in accord with Coleman's 
contention : 

M 2 

Stage 1 Strategies ^ = .108 

2 

Stage 2 Perceptions ^ = .217 

2 

Stage 3 Analogies y = 

Essentially tha same is true for the correlations of the subtests with 
achievement, except that perceptions and strategies change order (Table 
5) • Coleman suggests that in oirder for students of lower ability to 
achieve learning at Stages 2 and 3 additional activities such as post- 
game discussions are necessary. 

The initial optimism expressed by Boocock and Schild (1968) for simu 
lation gamea; and academically unsuccessful students must necessarily be 
qualified by the measure of academic success being used. Further studie 
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paying more attention to the way such variables are defined are needed 
if we are to understand what specific advantage games hold, if any, for 
the academically unsuccessful student. 
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ANOVA TABLE FOR THE TREATMENTS 
BY ABILITY WITHIN CLASSROCMS ANALYSIS OF 
VARIANCE 
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TABLE 3 



Analysis of Variance for Game Impact Variable 
Understanding of Game 



Source of Variation 


df 


SS 


MS 


F 


A 


1 


173.78 


173.78 


icif 

73.60(a) 


C/A 


2 


8.82 


4.41 


1.97 


T 


2 


2.84 


1.42 


1 


TA 


2 


5.02 


2.51 


1 


TC/A 


4 


27.04 


6.76 


* 

2.91 


Error 


99 


229.68 


2.32 

2.36(b) 




Total 


110 


447.18 







7 1 ' 

7 \c/^ - 



*P <.05 



** 

P 



<.01 



a F-ratio calculated using pooled error 
mean square 

b value of pooled error mean square 







Table. 4. Analysis of variance for subtest scores 
for understanding of game 
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p b Value of pooled error mean square 



TABLE 5 



Pooled Within-Cell Correlations 



i 



Type of Learning 


Achievement 


T/D - Total 




.12 


Perceptions 




-•11 


Strategies 




-.02 


Analogies 




* 

.33 


*p ^ .05; df = 83 

Correlation of Sex .and 


TABLE 6 

Scorer With Understanding 


of the Game 


Un de r s tan ding of the Game s 


Sex^ 


^ 2 
Scorer 


Total 


.10 


.02 


Perceptions 


.09 


.12 


Strategies 


-.15 


-.0 9 


Analogies 


* 

.25 


.01 




(n = 105) 


( n = 107) 



^Code: 1 = male; 2 = female 
^Code: 1 = no; 2 = yes 
*p ,05 (two-tailed test) 
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Figure 1. Mean scores of treatment groups in each class showing the treatment by class interaction 
for total understanding of the game and anologies. 

Ach = achievement; Un - understanding of game (total); An = analogies between game and real 

life. 



APPENDIX A. 



UNDERSTANDING THE GAME TEST 



Name ; 

These questions are. all about the game TRADE AND DEVEI/DP. Write the 
letter of the best answer. 

Perceptions 

C 1. In the TRADE AND DEVELC^ game, you get points for 

A) producing B) trading C) consuming D) all of these 

C 2. Which of these will give you the most points? 

A) one loaf and five boxes 

B) five loaves and one box 

C) three loaves and three boxes 

D) all of these will give you the same number of points 

A 3 . Having a green chart (instead of a blue chart) lets you 
produce more in 

A) agriculture C) consumer industry 

B) basic industry D) none of these 

Strategies 

_i\_ 4. If you are only going to get one factory, the best time 
to get it is in 

A) the first round C) any round except the first 

B) the last round D) it doesn't matter 

C 5- If you are going to get one tractor fleet, one factory, and 
one steel mill, which one should you get first? 
a) the tractor fleet C) the steel mill 

B) the factory D) it doesn't matter 

A 6. In which game should a player with a blue chart try to get 
tractors? 

A) a game with five blue charts and one green chart 

B) a game with one blue chart and five green charts 

C) a game with three blue charts and three green charts 

D) none of these games 

Analogies 

B 7 . The tokens with a picture of a loaf of bread stand for 

A) bread only C) all food except meat 

B) all food D) food and clothing 
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D 8. Which of these things could a "box" token stand for? 

“ A) clothing C) toys 

B) furniture of these 

A 9. Which of these things could a "steel beam" token stand for 

A) tools and machines C) TV sets and radios 

B) cars and bicycles D) all of these 

D 10. Each player in the game makes decisions for 
~ A) a family C) a city 

B) a company D) a country 
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